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Great  attention  has  been  lavished  on  the  visual  system  in  the  last 
generation — and  rightly  so.  For  this  system  may  provide  a  clue  as  to 
the  means  by  which  information  is  processed  on  its  path  from  the 
sensory  apparatus  to  'higher'  brain  centers.  But  as  is  suggested  in  a 
large  number  of  'deprivation'  experiments — experiments  in  which  the 
normal  development  of  visual  cortex  is  modified  by  abnormal  visual 
experience — the  visual  system  may  also  provide  a  means  of  testing 
neuron  learning  on  a  single  cell  level. 

For  the  visual  system*  we  can  control  the  dominant  input*  (in 
development  as  well  aa  in  testing)  as  well  as  measure  the  output.  This 
gives  us  the  possibility  of  measuring  the  change  of  response  of 
individual  neurons  as  a  function  of  the  sensory  environment  in  which 
they  are  placed-aasuming  that  what  is  observed  in  altered  visual 
environments  such  aa  monocular  deprivation  or  dark  rearing  are  changes 
in  responses  of  individual  neurons  rather  than  responses  of  different 
populations  of  neurons.  Although  it  seems  likely  that  this  is  indeed 
the  case*  the  question  will  probably  be  settled  finally  by  appropriate 
chronic  experiments. 

Even  though  such  neuron  learning  may  play  only  a  minor  role  in 
contributing  to  the  architecture  of  visual  cortex*  with  a  minimum  of 
fortune*  it  could  be  related  to  learning  that  must  take  place  in  higher 
brain  centers.  It  is  this  point  of  view  that  we  have  explored  over  the 

past  few  years. 


Here  are  inputs  and  synaptic  junctions  from  left 
and  right  eyes.  The  output  of  this  neuron  (in  the  linear  region)  can 
be  written 


c  =  m«d  +  m«d 

ll  r  r 


(1) 


This  means  that  the  neuron  firing  rate  (in  the  linear  region)  is  the 
sum  of  the  inputs  from  the  left  eye  multiplied  by  the  appropriate 
left-eye  synaptic  weights  plus  the  inputs  from  the  right  eye 
multiplied  by  the  appropriate  right-eye  synaptic  weights.  Thus  the 
neuron  integrates  signals  from  the  left  and  right  eyes. 

According  to  the  theory  presented  by  Bienenstock#  Cooper  and  Munro. 
1982  (BCM)  these  synaptic  weights  modify  as  a  function  of  local  and 
global  variables.  To  illustrate  we  consider  the  synaptic  weight  in, 
(figure  lb). 


Fig.  lb 

Local  and  Quasi-Local  Variables 


Its  change 


in  time*  m 


r 


can  be  written  very  generally  as: 


V  rWr  c“  X,T,Z); 


(2) 


Cortical  neurons  receive  afferent s  from  many  sources.  In  visual  cortex 
(layer  4*  for  example)  the  principle  afferents  are  those  from  the 
lateral  geniculate  nucleus  and  from  other  cortical  neurons.  This  leads 
to  a  complex  network  that  we  have  analyzed  in  several  stages. 

In  the  first  stage  we  consider  a  single  neuron  with  inputs  from  both 
eyes  (Figure  la). 


Here  variables  such  as  d  ...  m  are  designated  local.  These 

j  i 

represent  information  (such  as  the  incoming  signal*  d  .  and  the 

j 

strength  of  the  synaptic  junction*  m.  )  available  locally  at  the 
synaptic  junction,  m^  .  Variables  such  as  dJc  ...c  are  designated 
quasi-local.  These  represent  information  (such  as  c*  the  firing  rate 
of  the  cell*  or  d^  *  the  incoming  signal  to  another  synaptic  junction) 
that  is  not  locally  available  to  the  junction  m  .  but  is  physically 
connected  to  the  junction  by  the  cell  body  itself — thus  necessitating 
some  form  of  internal  communication  between  various  parts  of  the  cell 
and  its  synaptic  junctions.  Variables  such  as  c  (the  time  averaged 
output  of  the  cell)  are  averaged  local  or  quasi-local  variables. 

Global  variables  are  designated  X*Y*Z...  These  latter  represent 
information  (e.g.  presence  or  absence  of  neurotransmitters  such  as 
norepinephrine  or  the  average  activity  of  large  numbers  of  cortical 
cells)  that  is  present  in  a  similar  fashion  for  all  or  a  large  number 
of  cortical  neurons  (distinguished  from  local  or  quasi-local  variables 
carrying  detailed  information  that  varies  from  synapse  to  synapse). 

In  a  form  relevant  to  this  discussion*  BCM  modification  is  written 


(3) 


so  that  the  jth  synaptic  junction,  mj,  changes  its  value  in  time  as  a 
function  of  quasi-local  and  time-averaged  quasi-local  variables,  c  and 
c,  as  well  as  global  variables  X,Y,Z,  through  the  function,  i  .  and  a 
function  of  the  local  variable  d^ .  The  crucial  function,  <t>  .  is  shown 
in  Figure  lc. 


Fig.  lc 


The  BCM  Modification  Function 


What  is  of  particular  significance  is  the  change  of  sign  of  4  at  the 


modification  threshold*  0„,  and  the  non-linear  variation  of  0W  with 

N  M 

the  average  output  of  the  cell,  c.  In  a  simple  situation 


(4) 


The  occurance  of  negative  and  positive  regions  for  4  drives  the  cell 
to  selectivity  in  a  'normal*  environment.  This  is  so  because  the 

response  of  the  cell  is  diminished  to  those  patterns  for  which  the 

output*  c,  is  below  threshold  negative)  while  the  response  is 

enhanced  to  those  patterns  for  which  the  output*  c*  is  above  threshold 

C <f  positive).  The  non-linear  variation  of  the  threshold  with  the 

average  output  of  the  cell,  c*  places  the  threshold  so  that  it 

eventually  separates  one  pattern  from  all  of  the  rest.  Further  it 

provides  the  stability  properties  of  the  system. 

A  detailed  analysis  of  the  consequences  of  this  form  of  modification  is 
given  in  BCH.  To  illustrate  we  consider  the  various  final  states  for 
the  cell  under  rearing  conditions  characterized  as  follows: 


Normal  Environment ;  The  inputs  from  the  eye  are  a  stochastic  sequence 
of  patterns  possibly  distorted  by  noise  (these  patterns  represent  the 
mapping  by  retinal  and  *GN  cells  of  images  or  patterns  viewed  by  the 
animal).  In  normal  rearing  it  is  presumed  that  certain  patterns 
(edges*  for  example)  are  a  repeated  part  of  the  environment  and  are 
viewed  by  the  animal  many  times.  It  is  assumed  that  such  patterns  may 
be  distorted  or  may  appear  in  various  combinations  but  that  for  a 
normal  environment  the  patterns  are  statistically  independent. 

Restricted  ox.  Altered  Environment ;  The  inputs  are  restricted  to  one  or 
a  few  patterns  that  may  be  highly  correlated.  This  represents  the 
mapping  in  the  neural  space  of  a  restricted  or  artificial  environment 
(for  example,  one  in  which  only  vertical  lines  or  right  angles  are 
present). 

Hack  Reared  Environment :  The  patterned  inputs  are  replaced  by  random 
noise  that  represents  the  non-pat terned  input  due  to  dark  discharges 
and  spontaneous  activity  of  the  retinal  cells. 

Various  rearing  conditions  can  then  be  represented  as  follows: 


FT.H  n.» 


Manual  Binocular  Rearing: 


Correlated  patterns  input  from  both  eyes.  This  means  that  both  the  left 
and  right  eye  see  the  same  pattern  at  the  same  time. 


Strabismic  Rearing; 


Non-correlated  pattern  input  from  both  eyes.  In  this  case  the  left  and 
right  see  different  patterns  at  the  same  time. 


Monocular 


l:  (right  eye  deprived)Patterned  input  from  left 


eye.  noise  from  right  eye.  In  this  case  the  left  eye  sees  a  pattern 
while  the  right  eye  is  closed. 


Biaocttlai 


In  this  case*  both  eyes  being  closed  (or  kept  in  the  dark)  noise  is 
received  from  both  eyes. 


The  consequences  of  the  BCM  modification  in  these  classical  rearing 
conditions  are  shown  in  Figure  2. 


Fig.  2 


Computer  simulations  of  various  rearing  conditions.  Initial 
(dashed)  and  final  (solid)  responses  to  the  two  eyes  are 
shown  separately  (left/right). 


These  may  be  summarized  as  follows: 


Monocular ly  driven  neux.an,£ 

(1)  A  monocular ly  driven  neuron  in  a  "normal”  (patterned) 

environment  becomes  selective.  The  precise  pattern  to  which  it  becomes 
selective  is  determined  at  random  if  there  is  no  initial  preference  or 
may  be  biased  toward  a  particular  pattern  if  there  is  a  built-in  preference 
for  this  pattern. 

(2)  This  same  neuron  in  various  deprived  environments  evolves  as 
follows. 

PORE  NOISE.  The  neuron  becomes  less  selective  but  continues  to  be 
(somewhat)  responsive.  It  may  show  an  orientation  preference*  but  this 


is  relatively  unstable. 

EXPOSURE  TO  A  SINGLE  PATTERN  (such  as  vertical  lines).  The  neuron  comes 
to  respond  preferentially  to  the  single  pattern  but  with  less  selectivity 
(less  sharply  tuned)  than  if  all  orientations  were  present  in  the  environment 

(3)  Inhibitory  synapses  are  required  to  produce  maximum  selectivity. 

If  such  inhibitory  connections  are  arbitrarily  set  equal  to  0,  selectivity 
diminishes. 


driven  neurons 


(1)  A  binocularly  driven  neuron  in  a  “normal”  (patterned) 
environment  becomes  selective  and  binocular.  It  is  driven  selectively 
by  the  same  pattern  from  both  eyes. 

(2)  This  same  binocularly  driven  neuron  in  various  deprived 
environments  evolves  as  follows. 

UNCORRELATED  PATTERNED  INPUTS  TO  BOTH  EYES.  The  neuron  becomes 
selective*  often  monocularly  driven;  if  the  neuron  is  binocular* 
sometimes  it  is  driven  by  different  patterns  from  the  two  eyes. 

PATTERNED  INPUT  TO  ONE  EYE,  NOISE  TO  THE  OTHER  (monocular  deprivation). 
The  neuron  becomes  selective  and  generally  driven  only  by  the  open  eye. 
There  is  a  correlation  between  selectivity  and  binocularity .  The  more 
selective  the  neuron  becomes*  the  more  it  is  driven  only  by  the  open 
eye.  A  non-selective  neuron  tends  to  remain  binocularly  driven.  This 
correlation  is  due*  in  part*  to  the  fact  that  it  is  the  same  mechanism 
of  synaptic  change  that  serves  to  increase  both  the  selectivity  and 
ocular  dominance  of  the  open  eye.  However  there  is  also  a  subtler 
connection:  it  is  the  non-preferred  inputs  from  the  open  eye 
accompanied  by  noise  from  the  closed  eye  that  drive  the  neuron's 
response  to  the  closed  eye  to  zero. 


NOISE  INPUT  TO  BOTH  EYES  (dark  rearing  or  binocular  deprivation).  The 
neuron  remains  non-selective  (or  loses  its  selectivity)  and  diminishes 
its  responsiveness  but  remains  binocularly  driven  (in  contrast  to  the 
situation  in  monocular  deprivation). 

An  unexpected  consequence  of  this  theory  is  a  connection  between 
selectivity  and  ocular  dominance.  The  analysis  given  in  BCM  leads  to 
the  conclusion  that  the  more  selective  a  cell  is*  the  more  the  state  of 
the  closed  eye  will  be  driven  to  zero*  so  that  the  cell  will  be  more 
monocular.  Thus*  during  cell  development*  pattern  selectivity  for  the 
open  eye  is  achieved  before  the  cell  becomes  monocular  as  Figure  3. 


Figure  X*.  Progression  of  development  of  selectivity  and  ocular 
dominance.  Note  that  selectivity  develops  for  the  open  eye  before 
the  response  to  the  closed  eye  is  driven  to  zero. 

Since  non-preferred  inputs  presented  to  the  open  eye  are  a  necessary 
part  of  the  suppression  of  deprived  eye  responses*  if  inputs  to  the 
open  eye  are  restricted  to  preferred  patterns*  selectivity  may  still 
develop  but  the  cell  will  be  less  selective  to  the  open  eye  and  less 
monocular  than  it  would  be  in  a  non-restricted  environment.  Such 
effects  should  be  experimentally  observable. 


To  better  confront  these  ideas  with  experiment  a  second  stage  of 
analysis  is  necessary*  The  BCM  neuron  must  be  placed  in  a  network  with 
the  anatomical  features  of  visual  cortex;  a  network  in  which 
inhibitory  and  excitatory  cells  receive  input  from  LGN  and  from  each 
other.  This  has  been  done  (Scofield  and  Cooper  to  be  published).  Our 
conclusions  are  similar  to  those  of  BCM  with  explicit  further 
statements  concerning  the  independent  effects  of  excitatory  and 
inhibitory  neurons  on  selectivity  and  ocular  dominance.  For  example, 
shutting  off  inhibitory  cells  lessens  selectivity  and  alters  ocular 
dominance,  (masked  synapses).  These  inhibitory  cells  may  be  selective 
but  there  is  no  theoretical  necessity  that  they  be  so.  Further  the 
intra-cortical  inhibitory  synapses  do  not  have  to  be  very  responsive  to 
visual  experience.  Most  of  the  learning  process  can  occur  among  the 
excitatory  LGN-cortical  synapses. 

Quantitative  tests  of. progressions  such  as  those  shown  in  Figure  3  are 
in  progress  in  our  laboratory.  We  hope  that  such  experiments  can 
provide  detailed  comparisons  of  theory  and  experiment  and  provide  us 
with  a  sensitive  tool  for  determining  synaptic  modification  among 
various  classes  of  neurons--a  possible  entry  to  the  process  by  which 
the  nervous  system  organizes  itself. 
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FIGURE  CAPTIONS: 


Figure  la:  A  Model  Neuron, 


Figure  lb:  Local  and  Ouasi-Local  Variables, 


Figure  lc:  The  BCM  Modification  Function. 


Figure  2:  Computer  simulations  of  various  rearing  conditions. 

Initial  (dashed)  and  final  (solid)  responses  to  the  tvo 

eyes  are  shown  separately  (left/right).  In  this  figure.  NR 
means  normally  reared.  BD  means  binocular  deprivation.  MD 

means  monocular  deprivation  and  RS  means  reverse  suture. 


Figure  3:  Progression  of  development  of  selectivity  and  ocular 
dominance.  Note  that  selectivity  develops  for  the 
open  eye  before  the  response  to  the  closed  eye  is 
driven  to  aero. 


"*  V*  j’*  .*•  .*• 


REFERENCES! 


Bienenstock*  E.  L.«  L.  N  Cooper  and  P.  V.  Munro  (1982)*  “Theory 
for  the  Development  of  Neuron  Selectivity:  Orientation 
Specificity  and  Binocular  Interaction  in  Visual  Cortex*** 
Journal  of  Neuroscience  2.S32-48. 

Scofield*  C.  L.  and  Cooper*  L.  N.  “Selectivity  and  Ocular  Dominance 
in  Visual  Cortex:  k  Network  Theory” »  to  be  published. 


jtmjCm 


‘■^1 


